Setting defensible performance standards on OSCEs and standardized patient examinations.
نویسندگان
چکیده
Recently, standardized patient assessments and objective structured clinical examinations have been used for high-stakes certification and licensure decisions. In these testing situations, it is important that the assessments are standardized, the scores are accurate and reliable, and the resulting decisions regarding competence ar equitable and defensible. For the decisions to be valid, justifiable standards, or cut-scores, must beset. Unfortunately, unlike the body of research specifically dedicated to multiple-choice examinations, relatively little research has been conducted on standard-setting methods appropriate for use with performance-based assessments. The purpose of this article is to provide the reader with some guidance on how to set defensible standards on performance assessments, especially those that utilize standardized patients in simulated medical encounters. Various methods are discussed and contrasted, highlighting the relevant strengths and weaknesses. In addition, based on the prevailing literature and research, ideas for future studies and potential augmentations to current performance-based standard setting protocols are advanced.
منابع مشابه
A work-centered approach for setting passing scores on performance-based assessments.
Standardized patient examinations are being used for high-stakes decisions (e.g., graduation, licensure, and certification) with growing frequency. Concurrently, research on methods to determine the passing score for these types of performance-based assessments has increased. A wide variety of approaches have been considered in the past several years, many based on traditional techniques develo...
متن کاملWhat does an OSCE checklist measure?
In this issue of Family Medicine, Drs Turner and Dankoski1 raise questions about the reliability and validity of objective structured clinical examinations (OSCEs). They propose that many institutions may be using an OSCE that does not have adequate reliability, and their interpretation of the literature is that the validity of OSCEs has not been established. I agree with their conclusions. The...
متن کاملUsing borderline methods to compare passing standards for OSCEs at graduation across three medical schools.
CONTEXT Medical schools in the UK set their own graduating examinations and pass marks. In a previous study we examined the equivalence of passing standards using the Angoff standard-setting method. To address the limitation this imposed on that work, we undertook further research using a standard-setting method specifically designed for objective structured clinical examinations (OSCEs). MET...
متن کاملObjective Structured Clinical Examination (OSCE) Revisited.
Objective structured clinical examination (OSCE) was introduced in 1975 as a standardized tool for objectively assessing clinical competencies - including history-taking, physical examination, communication skills, data interpretation etc. It consists of a circuit of stations connected in series, with each station devoted to assessment of a particular competency using pre-determined guidelines ...
متن کاملSimulated patients and objective structured clinical examinations: review of their use in medical education
Simulated or standardised patients have been used in medical education and other medical settings for some 30 years (Box 1). Their use encompasses undergraduate and postgraduate learning, the monitoring of doctors’ performance and standardisation of clinical examinations. Simulation has been used for instruction in industry and the military for much longer (Jason et al, 1971) but the first know...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Medical teacher
دوره 25 3 شماره
صفحات -
تاریخ انتشار 2003